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Have you ever seen one of those movies where the hero unearths 
an artifact covered with mysterious symbols, and it takes a brilliant 
scientist to decipher their meaning? The best of Hollywood creativity 
goes into devising a plausible system for the symbols. In the movie 
Contact, for instance, Jodie Foster discovers a datastream of symbols 
that turn out to be a 3-dimensional blueprint for a device to contact 
alien life. Hollywood's tacit (and reasonable) assumption is that the 
mathematics of a different civilization would look very different. 

This paper provides an accessible introduction to trace diagrams, a 
non-traditional notation for linear algebra that could plausibly have 
been developed by another civilization. Trace diagrams are a com- 
pletely different way of looking at vectors and matrices. Vectors are 
represented by edges in a diagram, and matrices are markings along the 
edges of the diagram. Instead of representing dot products and cross 
products by u - v and u x v, one glues together the edges corresponding 
to those vectors. One example is shown in Figure 1. 




Figure 1. A trace diagram representation of a matrix determinant. 

l 



2 



Surprisingly, the notation is perfectly rigorous, and often leads to 
proofs more elegant than those written using traditional notation, as 
we will show for vector identities. While trace diagrams have powerful 
applications in mathematics and physics [TJ [2], the only prerequisite 
is an understanding of basic linear algebra and a willingness to work 
some examples to get used to doing real math with "doodles" . 

On Notation. Whether one believes that mathematics is created or 
discovered, notation is certainly created. And that notation can direct 
the course of mathematics. For instance, a matrix encodes the same 
information as a weighted directed graph, but the two notations inspire 
completely different questions. Matrices focus attention on concepts 
such as rank and invertibility, while graphs focus attention on nodes 
and flow between nodes. 

Sometimes notations persist because they are useful and easy to un- 
derstand, but there also cases where they exist simply because they are 
easier to write down in a single line of text. For example, permutation 
cycle notation such as (2 1 3) is precise and easy to write down, but it 
is nonintuitive and often confuses beginners. The same permutation is 
much more clearly depicted by the diagram 



There are many other cases, such as commutative diagrams, graph 
theory, and knot theory, where any attempt to fit the concepts into a 
single line would render them incomprehensible. 

Outside of a few niche areas, diagrammatic notations have not been 
widely accepted. This is at least partly due to the difficulty in pub- 
lishing. In fact, notations similar to trace diagrams have been used by 
mathematicians and physicists for years. In some cases researchers have 
"invented" new diagrammatic notations, only to discover that they al- 
most perfectly replicate notation in a long-forgotten manuscript. 
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In the case of trace diagrams, there is a huge benefit in escaping the 
confines of a single line of text. The diagrammatic notation focuses 
attention on different questions, opening up new ideas that are not 
as readily achieved in the traditional manner. They also provide a 
refreshing perspective on the traditional theory. 

Outline. We begin with the definition of trace diagrams, and move di- 
rectly into two special cases that help orient the reader to the diagram- 
matic point-of-view. We then provide an explicit description of how 
they are calculated. Finally, we provide the diagrammatic perspective 
on some questions often posed by students seeing vectors and linear 
algebra for the first time. We also look at some questions inspired by 
the diagrammatic notation. 

We include several examples and exercises throughout, which are 
particularly important for adjusting to nonstandard notation. The 
reader is strongly encouraged to follow the examples closely and to 
complete the exercises. 

I. General Trace Diagrams 

Definition. Given an underlying vector space of dimension n, a trace 
diagram is a graph whose edges represent vectors. Endpoints of edges 
may be labeled by vectors, may be left free, or may be joined at ordered 
nodes of degree n. Matrix markings may occur along any edge. 

By ordered node, we mean that the edges adjacent to the node are 
ordered. Matrix markings are directed nodes placed along an edge and 
labeled by an n x n matrix. 

The free ends of the diagram, along with those labeled by vectors, 
are typically partitioned into a set of inputs and a set of outputs. Each 
trace diagram gives rise to a function with corresponding input and 
output vectors. 

If a trace diagram consists of two disconnected pieces, the individual 
functions are multiplied together to obtain the function of the entire 
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diagram. Sums of multiple diagrams are also permitted, with the cor- 
responding functions added together. 

The next two sections describe special cases of trace diagrams, and 
are intended to clarify these ideas and to help the reader grow com- 
fortable with diagrammatic reasoning. We will describe functions cor- 
responding to trace diagrams, but will not say why these are the right 
functions until section HI where we answer the question of how to com- 
pute functions for arbitrary diagrams. 

The following result encapsulates the power of the diagrams: 

Fact. Topologically equivalent trace diagrams correspond to equal func- 
tions, provided (i) the ordering at nodes is preserved, and (ii) the or- 
dering of inputs and outputs is consistent. 

Although the diagrams are drawn in the plane, no proof is necessary 
of this result since trace diagrams are defined combinatorially. We refer 
the reader to HI for further details. 



The two main operations on 3-dimensional vectors are the cross prod- 
uct and the dot product. In 3-diagrams, a special case of trace diagrams 
that has been used for many years [6] , the diagrammatic forms of these 
operations are 



A 3-diagram is a graph with nodes of degree 3 and edges representing 
3-vectors. If an edge is labeled by a particular vector, indicating that 
it has known value, it is an input to the diagram's function. These 
are usually drawn at the bottom of the diagram. If an edge is free, 
meaning it has an unlabeled end, it is an output of the function, and 
usually drawn at the top of the diagram. 

Both diagrams in (pQ) have input vectors u and v. In the cross prod- 
uct diagram, the third strand is the output, identified with the vector 



2. 3-DlAGRAMS 



(1) 




and u ■ v 
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result u x v. The dot product diagram has no outputs. In this case, 
we say that the value of the diagram is the scalar result u • v. 

Example 1. Draw the identity 

(u x v) ■ (w x x) = (u • w)(v ■ x) — (u ■ x)(v • w). 

Solution. Keeping the vector inputs in the same order, the diagram is: 



\u\ [v] [w] [x] \u\ [v] [w] [x] ful [vl [wl [xl 
Exercise 2. What vector identity does this diagram represent? 



[ul [vl [wl [ul Fvl [wl ful [vl [wl [ul fvl [wl 
(The reader is encouraged also to guess the meaning of the fourth term.) 

This exercise illustrates the first kind of diagrammatic proof: the 
"unproof". No work is required to prove (J2J), since the pictures are 
topologically equivalent and maintain the same ordering at the vertex. 
In contrast, here is the traditional direct proof of the first equality. 
Take u = (ui,u 2 ,u 3 ) and a similar notation for v and w. Then 

(U X v) • W = (u 2 V 3 - U 3 V 2 , U 3 V 1 - UiV 3 , u x v 2 - u 2 v x ) ■ {wi,w 2 , w 3 ) 

= U 2 V 3 Wi - U 3 V 2 W\ + U 3 V 1 W 2 - U 1 V 3 W 2 + U\V 2 W 3 - U 2 VxW 3 \ 

U ■ (v X w) = (Ui, U 2 , U 3 ) ■ (V 2 W 3 - V 3 W 2 , - VxW 3 , ViU> 2 - v 2 w x ) 

= UlV 2 W 3 - UlV 3 W 2 + U 2 V 3 Wi - U 2 ViW 3 + U 3 V\W 2 - U 3 V 2 Wi 

= (u x v) ■ w. 

The proof is trivial, but completely unenlightening. A student might 
assume the identity is just a coincidence. In truth, the identity exists 
because of notation rather than the underlying mathematics. 

A second type of proof is the "surgery proof" , in which we use what 
we know about simple diagrams to perform manipulations with more 




(2) 
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complicated diagrams. For example, we know from Example [T] that 



Here, stating the identity without labelings indicates that the identity 
is true for any choice of vector labeling, under the assumption that 
inputs in the same position are labeled by the same vectors. This 
identity may be applied at any two adjacent nodes in a 3-diagram. 

Example 3. Find an alternate expression of (u x v) x w. 

Solution. First, represent (u x v) x w in diagrammatic form. Then 
apply (j3J) in the neighborhood of the two nodes, manipulating the po- 
sitions of the strands as appropriate: 



By repeated application of one can write any single expression 
involving multiple cross products as a sum of expressions with at most 
one. 

3. Diagrams with Matrices 

In diagrams with matrices, the matrix markings are directed nodes 
placed along edges. We use a chevron symbol to represent matrices, as 
in the diagrams 



where AB is a legal matrix product and v T is a row vector. The 
directionality of the node is required to specify the input and output 
of the matrix. 



(3) 





This proves the following identity: 



(u x v) x w = (u • w)v — (v ■ w)u. 





One may use this to represent matrix entries diagrammatically, using 
the expression a^- = e l Aej for the entry in the ith row and jth column 
of A, where {e*} and {e.,} are the standard row and column bases for 
the vector space. The diagram is 

(5) aij = e'Aej = jjj. 

Example 4. Find a diagrammatic representation of the trace tr(A). 
Solution. tr(A) = Yn=i a ™ = Yh=i f • 

Example 5. Find a diagrammatic representation of the determinant 

(6) det(A) = b gn(cr)a lo -( 1 )a 2(J (2) • • -aW(n)- 

creS n 

Here, a G S n is a permutation on n elements, and sgn(cr) is the signa- 
ture of the permutation, defined to be (— l) fc , where k is the number of 
crossings in a diagram of the permutation. 

1 1 - I 

Solution. One approach is to introduce new notation. If ^ °_ J represents 
a permutation a on the n strands, then 

[T][2] _ _ _ m 



det(A) = ^ii(rrj — ^ — ^ 



For example, if n — 2, then det(yl) = MM — MM = ana22 — 012021- 

4. Computing Trace Diagram Functions 

Let {§1, . . . , e n } be an orthonormal basis for an n-dimensional vector 
space. A basis diagram is an n-trace diagram in which every edge has 
been labeled by one of these basis elements. We use i as shorthand for 
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The general process for computing a trace diagram's function in- 
volves two steps: 

(1) Express the diagram as a summation over basis diagrams. 

(2) Evaluate each basis diagram, and add the results together. 

We describe the second step first. 

Basis diagrams evaluate to either or a signed product of matrix 
and vector entries according to the following rules: 

Matrix Rule. Each matrix and vector on the diagram contributes an 
entry to the product, according to the rules 
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Node Rule. Nodes contribute multipliers of 0, if adjacent labels are 
repeated, or sgn(r) ; if the adjacent labels form a permutation r. 

In the case where labels are not repeated, a convention is required 
to read off the permutation precisely. We use a small mark called a 
ciliation near the node, and read off the permutation in a counter- 
clockwise fashion starting at that mark. (If the dimension is odd, 
the counter-clockwise ordering is enough to provide the sign of the 
permutation, since, for example, ( 123 ) and ( 231 ) have the same sign. 
So we can omit ciliations in this case.) 

For example, the node 

has edges ordered (2, 4, 1, 3), so the permutation is (2413)- The number 
of transpositions required to express this permutation is 3, so the node 
contributes a sign of —1. 

Now we treat the question of how to express diagrams as sums of 
basis diagrams. For now, we assume that there are no free edges. The 
summation uses the following rule: 



Inferred Summation Rule. Express each edge in the diagram that 
is not already labeled by a basis element as a sum over basis labels: 

i n i 

i=i 1 

This rule is the analog of the expression of the identity matrix / as 
the sum / = Y^i=\ ■ 

The following example computes the dot product diagram in (CQ). 

Example 6. Show that J^~^-. = u • v. 

|U| I v I 

Solution. Use inferred summation over the interior edge. 



ii n n 



rtri pvi ^ — ' 



i=l i=l 

The next example justifies the terminology 'trace' diagrams: 
Example 7. Evaluate the diagram 

Solution. Infer summation over the n basic labels on the interior edge: 

n Ufi n 

(8) (3=Z)i = E a « = tr ( A )- 

i=l i i=l 

Si X 

The rule X = for matrix products follows by inferred summation 
on the strand connecting the two matrices: 

n n 

~- ^ I = aikhk i = ( AB ^ = 

fe=i W fc=i 

A similar approach allows vectors in diagrams to be reduced directly, 
in the sense that 

This vector summation rule is the analog of the equation v = Y17=i v ^ii 
and may be proven by applying (J7j) on the edge in 
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Example 8. Given u = and v = ( V1 ), evaluate (*\ . 

U2 V2 [ul \y] 

Solution. Using (Q and the node rule: 

2 2 

= u * v i 

i=l j=X 

Exercise 9. Show, as suggested in Exercise [2], that 




u\v 2 I \ +u 2 vi± J, = u 1 v 2 -u 2 vi 

l\ [2l 1| 



Ui V\ 

u 2 v 2 



Ui Vi Wi 

u 2 v 2 w 2 
u 3 v 3 w 3 



U X V • w. 



[ui Fvl [wi 

Exercise 10. (Harder) Given an n x n matrix A, show that 





and that 




det(A) 



;-l)LtJn!det(A). 



We have not yet described how to compute functions for diagrams 
with free (unlabeled) edges. These edges correspond to outputs of the 
underlying functions, and the rule for computing them is as follows: 

Free Edge Rule. A diagram with a single free edge corresponds to 
a function with output w = (wi, w 2 , ■ ■ ■ , w n ), where Wi is found by 
labeling the free strand by the basis label i and evaluating the result. 



For example, has a single free edge, corresponding to output 

1 

w = (wi,w 2 ,w 3 ). The vector summation and node rules give 

Wi = /-*\ = u 2 v 3 - u 3 v 2 . 

Exercise 11. Compute w 2 and w 3 in the above example. Then explain 
why = u x v. 

m m 
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The rules discussed in this section can be used to evaluate any trace 
diagram with a scalar or vector output. We refer the reader to [I] for 
an explanation of how to compute diagrams with multiple outputs. 

5. A New Look at Some Old Questions 

The following questions are often asked by advanced students in 
multivariable calculus and linear algebra courses: 

Question 1: Is there any pattern underlying vector identities with dot and 
cross products? 

Question 2: Why is the cross product defined "only" in three dimensions? 
Question 3: Is the rule for computing cross products using a determinant 
just a coincidence? 

Question 4: Why do the trace and determinant show up in the discussion 
of eigenvalues and the det(A — XI) = equation? 

Some readers may have ready answers for these questions, but to a 
student seeing vectors or matrices for the first time, the answers may 
not be readily understood. 

Trace diagrams are a good source of intuition for these problems, as 
it is often easier to generalize visual patterns than algebraic ones. 

Question 1 has already been addressed. The diagrammatic rule 
(J3j) unifies all vector identities involving more than one cross prod- 
uct. Finding the identity is as easy as finding two adjacent nodes in a 
diagram. 

For Question 2, the visual cross product easily extends in dimension 
n to 




= U! x u 2 x ■ ■ ■ x U n _!. 



From a visual perspective, there is zero coincidence in Question 3. 
Trace diagrams that differ only in placement of inputs and outputs 
represent the same underlying concept. In the correspondence with 
linear algebra, these inputs and outputs play almost identical roles in 
computation. So the determinant /T\ = det [u v w] and the cross 

111 1 1 tr II Txr I L J 
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product = u x v are merely two different windows into one 

\m |vj 

idea. This visual perspective also begs the question of what the related 
diagrams and represent algebraically. As the answer involves 
terminology beyond the scope of this paper, we refer the interested 
reader to [I] to uncover the answer 

Before getting to Question 4, consider this combinatorial question: 
what are the simplest closed diagrams marked by a matrix A? The 
simplest case is l^f^) = ^ T (A), with no nodes. If the diagram has one 
node and is closed, n must be even. Moreover, any unmarked edge in 
the diagram would produce a multiplier of 0, so the only case is 







(10) 

Two-node diagrams include the family 
(11) 

The following result gives a partial answer to Question 4: 

Theorem (Corollary 20 in [5]). The diagrams in ( Hip are the coeffi- 
cients of the characteristic polynomial det(^4 — XI), up to a multiple 
that depends only on n and the number of marked edges. 

In this case, the diagrammatic pattern indicates a new way to under- 
stand the characteristic polynomial. The trace and determinant, which 
are constant multiples of the first and last diagrams in (fill) , show up as 
special cases of a family of diagrams representing all coefficients of the 
polynomial. The traditional notation for these coefficients is tii(A), 
where i — 1, . . . , n is the number of marked edges. 

There is more to say about closed diagrams marked by a matrix 
A, and many unanswered questions. What is the function underlying 
( ITU]) ? (We believe it to be the Pfaffian, but have not yet proven this 
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fact.) What are the other diagrams with two nodes, and what are 
their functions? What can be said about diagrams with more than two 
nodes? 

6. Concluding Remarks 

Trace diagrams are particularly suited to recognizing and generaliz- 
ing patterns in vector and matrix algebra. In many cases, they lead to 
simple or even "trivial" proofs. Moreover, linear algebra is decidedly 
nonlinear, in the sense that matrix algebra does not naturally play out 
along a 1-dimensional line of text. One can reasonably argue that the 
diagrammatic notation for the cross product, the trace, and the deter- 
minant is a better approximation of the underlying "truth" of these 
concepts than the standard u x v, tr(A), and det(A). 

Trace diagrams also have a strong potential to help advance certain 
areas of mathematics. In invariant theory, they simplify the process 
of generating and understanding trace relations, which is fundamental 
for recognizing structures of interest in the theory. In another inter- 
esting connection, the four-color theorem may be expressed entirely in 
terms of these diagrams |3J. Independent of these applications, there 
are many unanswered questions about the diagrams themselves, par- 
ticularly when matrices are restricted to certain groups. 

Trace diagrams are not likely to revolutionize linear algebra, but 
they provide a refreshing perspective and a new way to understand the 
subject. And one cannot help but wonder what linear algebra would 
now look like if trace diagrams had been as easy to typeset as rows and 
columns of numbers. 
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